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ABSTRACT 

The process being used by the University of 
Hontevallo (Alabama) to evcLLuate the outcomes of its general 
education program is presented. En^hasis is on the triangulation 
procedure used to evaluate the validity of the outc<»SBe measure 
selected— the college Outcomes Measures Project (a3MP) Test of the 
American College Testing Program (1984). The University had 
implemented a common core curriculum in 1985 that included a set of 
goals for the general education program. Ttie evaluation method 
required the faculty to determine the relationships between the core 
goals and the Knowledge measured by the COMP Test, between the goals 
and core courses, and between the knowledge measured by the coMP Test 
and core courses. The triangulation of these three components 
provided insight into the validity of the COMP for evaluation. As 
longitudinal data on student progress toward the goals accumulate and 
relatively weak areas are established, the developed matrix can be 
used to identify how courses address goals, validity is demonstrated 
when the test, gwils, and core courses overlap; a lack of overlap of 
any two components will suggest problems. The process has proved 
non-threatening to faculty and has stimulated discussion alx>ut ways 
of assessing outcomes. One f:Lgure is included. Four appendices 
provide the goals, the evaluation model, a table of relationships 
between core goals and the curriculum, and a sample curriculum 
validation worksheet, respectively. (SLD) 
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A Triangulalion Approach to ihc 
ValiUalion of the COMP for Outa>racs Evaluation 

Evaluators have long cautioned against program evaluations that examine only prwesscs. 
Until recently, mast accrediting bodies used models that were dominated by input and prc^ce.vs 
cvalualiim. As local accrediting Mies and then a state education agency (Mississippi) adopted 
outcomes oriented accreditation, the regional accrediting bodies began to pay attention. The fin»t 
of these to forniiilly adopt an outcomes or institutional effectivenesx standard was the Soulljern 
A«isociation of Colleges and Schools (SACS, 1987). 

Tiiis movement is posit s e from an evaluator standpoint in that evaluators arc now involved 
at a wide range t)f levels in the accreditation process. The outcomes accreditation standards have 
spawned a new induslrj' of outcomes oriented measurement instruments and pcrsonnei positions 
for or even offices for outcomes evaluation. Along with this new mo\cment have come the 
associated problems. Not the iea:,t of these pi-obiems is the selection and validation of inslriiments 
to measure the outcomes of our educational prtxesses. 

The purpose of this paper is to present a case study o! one institution's sirug<:!c Id e\ai"ate 
the outcomes of its general education program, 'llic emphasis is on the triangulalion prtKcdurc 
u.sed to evaluate the validity of the outcome measure selected for the siudv. It is hoT)efl iii;it 
shared experiences such as this will lead to improved outcomes a.ssessmcnt nationwide. 

Background 

There has been a resurgence i3i interest in general education,/liberal education in recent 
years (Foyer & Levine, Gaff. m\ ME Study Group on the Conditions of Lxccllcnce in 

Americiin Higher liducalion. Vm). 1 his has been loupled with a movement in the la.si f.-w ye;irs 
ln\v;ird the cvahiaiion t^f oulconu-s nf ptosis. ■.-ondary t.tiiiv;!lion (IkntJet. undated: Hover. 1.\kc\\. 



1 



Finney & Mingle, 1987; Ewcll. 1987; Harllc, 1985; NIE Study Gmup on the G)ndiiit>ns of 
Excellence in Ameriain Higher Education, 1984). as evidenced by the slates and accrediting 
aiiencies now requiring outcomes assessment (Boj'er el al.. 1987) and by four national conferences 
(heiti in Columbia. SC. October. 1985; Denver, CO. June, 1987; Chicago. IL, l'>8.^; and Atlanta. 
OA, 1^'8^)) on assessing outcomes uf higher education. The American Evaluatinn Association now 
has a TIG on Assef-smenl in Higher Education that is sponsoring this session. 'ITic last three have 
been sponsored by American Association of Higher Education. Leadere in the outcomes 
assessment movi:ment have stressed the importance of developing evaluations that are spcciHc to 
a given educational in.siiiuiion/program and its own goals (Bennct, undated; Edgerton, Callan. v<c 
Read, mi; Exveil, 19S4. 1987: Hartle, nm: Smith. '.987; Stewart, 1987). IJniil recently, however, 
slandardizi d mijasu-ement instruments to assess student attainment of the goals cif general 
education did not exist. The College Outcome Measures Project (COMP) Test, developed by the 
/Vincrican College Testing Program (1984) in the early 19S()s. was the first naiitjnally standardized 
instrument designed for this purpose (Eorrcst & Steele. 1982). The Educational Testing Service 
(Il l's) has tieveloped Ihe Academic Prollle and its successor. The Academic Profile 11 {AP II). 
amither in:Urumcnt designed to a.^sess general education outcomes (.\Unian. 1987). American 
College Testing Pn^gram has developed the Collegiate Assessment of Academic Proficiency 
{(■ wXP). 

Program c\alu:u;on.s are often undertaken by faculty or administrative personnel who have 
little e.xper'ence in selecting and using assessment instruments and therefore are ofien uncertain 
aln)ut how to evaluate a particular instrument {o determine its upproprialene.ss for mea.suring 
specitic ifis;;!ijtion;il Is. Muny .schools have instituted genera! education programs :>nd have 
bt-gun to v. ■'huac ih. ; •. using the COMP or APII or umsidering their u>e. often doing so wiihoui 
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lulaling the test directly to their own educational goals, and wiihtjui having any clear way of 
knowing which of their goals are, or are not, being assessed by these test*. 

A seemingly straight-forward question such as the validity of COMP has many hidden 
prt^blems when the test is used for outajmcs evaluation. St^me of these problems currently have 
no solutions. For example, since education is cumulative, there is no way to attribute specific gains 
in knowledge to a spccifii: instructional period of time even in experimentally designcii studies. 
Further, the outcomes of educational instruction may not manifest themselves until yean; after 
the instrut:tion. particularly if the outcom(» are due to interactions between the instruct itm and 
other events. 

An outcomes evaluation for an institution has another major weakness common to many 
outcome oriented evaluation studies. ITiat weakness is the lack of a reasf>nable comparison group. 
Obviously, randomization is not possible. But obtaining any comparable group that did not receive 
the instruction wi>uld be almost impossible. This problem bears many similarities to the proble.Tis 
encountijred in trying to evaluate many compensatory education programs in the 196()s and 197(^. 
Thus, an institutional outcomes assessment must be limited to a no ci^mparison group appi(i;ieh or 
use itself as a comparistm (time -series). 

Method and Example 

'Ihis paper provides a description of an experience with outcomes evaluaiiun at the 
University of Mtmlevallo (UM). Tiie IJM is a small slate-supported institution with a sirtmg 
liberal education mission and a regionally recruited student bt)dy. The UM implemented a 
ctMnmon core Lurriculum in 1985 following eight years of goal definition and program development 
by the faculty {IJniversity i^l Montevallo. 1978. 1983). 'I"his curriculum included a set of goals for 
the general eduealitin program as defined by thi i>re curriculum (see Appendix A) and is now 




referred to as general educatiorL 

Evaluation was frum ihc start a comptincnt of the overall plan, not a result of any externa! 
pressures. The evaluation process was designed for program improvement-- to identify which stated 
goals were and were not being met and to provide direction for designing ways to enhance the 
areas where goals were not being met adequately. 

An evaluation subcommittee was named from the UM General Education Committee to 
design and carry out an evaluation of the general education program. Initial efforts of the 
evaluation subcommittee in 1983-84 were directed toward identification of a measure of general 
education outcomes suitable for evaluating the university's general education program. Criteria '"or 
an instrument snclude^^ (a) objectives consistent with the I'M program, (b) standardized format 
with research-based validity and reliability studies, (c) participating insliiulions similar to UM. and 
(d) available national norms. The instrument also needed to be currently available since the 
seniors of 1984 were the last students who were products entirely of the previous genera! 
education (distribution requirements) program and their outcomes were needed to establish 
ba.seline data (Ernest & Rodgers, 19i%). The evaluation subcommittee selected the COMP exam 
to assess UM's general education outcomes because, at the lime, it was essentially the onlx 
nationally standardized instrument available, and becau.se it appeared to address many c>f the 
uni-.. ; iiy"s ;4cneral education goals. 

The evaluation mmmittee realized that COMP. even if it proved to be valid, was Diily one 
aspect of the overall evaluation. Thus, in consultation with personnel from the Evaluation and 
As.sfssmcnt l^btjralory. at The University of Alabama, they developed ;m overall mod-jl ot their 
geiv education programs that included the majt^r components of an cv.iluaiit-sn (see 
Ap|- •uli.s B). 
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Obviously, COMP may not measure all of the goals of the genera! cducilion program and 
the first step was a study of the validity of COMP for this purpose. It was recognized that in 
order to demonstrate that COMP was valid, three components of the evaluation must converge- 
the knowledge being measured by COMP, the goals of the general cducaiii^n program, and the 
content of the general education courses (see Figure 1). In terms of recent measurement 
vocabulary, we wanted to assess the curricular and instructional validity of the COMP for the 
outcomes evaluation of the UM general education component. 

The first step was the comparison of the general education gtnils with the COMP goals. 
Appends C presents a matrix that shows the relationship l^twcen the general education goals and 
the COMP goals with the COMP questions that supptxscdly measure each COMP goal. The 
mutrL\ in Appendix C was used as the basis of the evaluation. It assisted the evalualt^rs in 
accfjmplishing the following tasks: 

1. Identify general education goals that have no corresponding COMP goal. This was 
done by identifying obvious omksions in the COMP columns of the matrix. An 
omission reveals where no COMP goal corresponds to one of the institution's general 
education goals, indicating that other measures need to be found or developed to 
assess this goal. This review, done by the evaluation subti.mmitlec. identified several 
goals that were not being a.s«:ssed by COMP, including such things as understanding 
the history of ideas, application of health information to personal lives, and habits of 
critical inquiry that lead to lifeloni;; learning. 

2. Identify COMP score areas that can be ignored in iLS-sessinji ihe general cducaliou 
outcomes. This can be done by identifying objectives COMP w;js designed lo measure 
but that are not goals of the institution's GE program. At UM. this was also done 
by the evaluation subcommittee, and restialed that all COMP goals were at least 
indirectly related to the general euucatii'in goals. 

3. Identify general education goals that may be subtly dilTerent from apparently equivalent 
COMP goals. This can be done by a close review of overlap areas, where COMP 
seems to directly address institutional goals, but where subtle dilTerenccs may exist ih.ii 
need closer scrutiny. The evaluation subcommittee reviewed goal statements cureli.; • 
to idenlily such subtle differences, including cases where most but n . il! im' : 
ct)m{X)nents of a general education goal were covered by a COMP ennl. niiiiu: - 
iliscussion. differences were determined to he lri%!.i! or substiinii.-ii, ii Vt 
deemed trivial could be ignored, and the general cdiiv'aiion and CO.MP i- aiuki 
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a COMP Test measures material identified by Core Goals 
(but not taught in Core Courses). 

b Core Courses teach material identified by Core Goals (but 
material is not tested by the COMP Test), 

c COMP Test measures material taught in Core Courses (but 
not related to Core Goals). 

d Validity is achieved at the triangulation of the COMP Test, 
Core Goals, and Core Courses, i.e. material covered by the 
COMP Test and required by the Core Goals is taught in the 
Core Courses. 



Figure 1. Relationship of Validity to the Core Goals, 
Core Courses, and COMP Test. 



3. continued 



considered essentially ihe same. DitTcrences deemed substanliai, however, indicated 
additional areas where other means of assessing general education goals needed to be 
sought In cases where the goal statements thcmscWcs did not provide enough 
information, questions were left to be considered in the next step. 

4. Enlist the aid of the faculty in examining the curricular validity, and to some extent 
content and construct validity, of the COM? test as a measure of institutioaal goals. 
Faculty members who taught general education cxiurscs wt:rc asked to go through the 
COMP test in detail to determine the relationship of the COMP items to the 
institution's general education goals. TTiis relationship was determined through the 
process of (a) identifying items that do not seem to test the related institutional goal, 
and (b) considering each cluster of items to determine if the items taken together 
addn:ss the intended goal fairly well or if they do riot adcquatcl> Jdress the goal If 
the item clusters were seen as adequate for the goal, ihcn COMP was assumed lo 
measure this particular ouiuomc of general education. If they were not seen as 
adequate, then there Is .still need for another measure of this goal 

Sixteen UM faculty members, ail involved in teaching general education courses, were 

selected to examine COMP. section by section and item by item, as describcJ in the four above 

stcp.s, to ascertain the Unral curricular validity of the tcsL These faculty were provided with i: set 

of worfaheets. each with one of the UM General Education Goals at the top, followed by the 

apparently relevant COMP goals and the item numbers of each COMP item purportedly assessing 

that particular goal. A .sample wcirkshcci is in Appendix D. Faculty were given copies of the 

COMP test and were presented the .jusiliary audio-visual materials accompanying the test. 

Approximately one-third ol ihe.sc faculty h.id earlier "taken" the COMP wsi during reguhir student 

administrations. During this special faculty administration. h<"\\c:\er, as each .section was 

administered, the faculty responded to the questions and then ii.-.cussed that section before 

participants went on to the next section. For st)me sections of the test where stimulus maieiials 

are in the test biK)klel, only part of the faculty group (those m< st familiar with the particular 

content area being tested) examined the test ciMiient. 



Folkwing administration of COMP. faculty were asked to respond ic? three questions. 
First, in their perception. w:rc there any general education goals for which there were no 
corresponding COMP goals. Although thb question had been addressed previously by the General 
Education Committee and the evaluation suhcommiltec (see matrix development ahive), it was felt 
that thus was a gixxl way to introduce the faculty to the lest itself and Ici refresh in their minds the 
goals (^f the General Education program. Second, were there any general education goals thai 
appeared suhily diffcR^nt than the apparently equivalent CC^MP goals. Third, were there any test 
questions which they fell to be misleading, incorrectly kc>'cd, or not really testing the general 
education and/or COMP goal which they were supposed to address. 

The instructional validity was addressed by surveying the faculty who teach the general 
education curriculum courses (Rogers & McLean. 1986; Rogers, Ik)lland. Moon, & McLean, 1986). 

Respon.ses to questionnaire items were tabulated in several ways to pmvide multi-level 
interpretation of the results. First the items were grouped by goals, and tables prepan:d to show- 
total faculty respt^nsc to each item related to a goal (Complete tables are available on request). 
'the results indicate that every one of the General Education goals is indeed being addressed in 
many cour.ses. Becau.se of the diversity of courses and the disproportionate representation of 
physical education courses, some of the goals do not at first appear to be emphasized in as high 
a percentage of courses us might he expccied. The tabulated results must therefi^re be inierpreied 
with caution. A less ambiguous picture of the results may be .seen in the more detailed 
breakdowns. 

Next, courses were groujx-'d into general education core areas and items organised within 
i'reas by Goals. The Evaluatiim Subci^mmittce and the General Filuc.ition Committee hooked at 
these tables closely, for they provided the nu>.\i complete infornhitit>n Gml emphasis by area 
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of instruction. 

Finally, when one tif several courses was selected to meet a general education core area 
requirement (lc., distribution requirements), they were tabulated lo show the extent to which each 
individual course covered each Goal. Once again, small frequencies indicatt' the need for care in 
interpretation. Th^^s^: tablen, along with the ones in the pre\ious group whc.x* only a particular 
a)urse a)uld be selected to meet a r»:quirenient. provided the most def .iiled le\el of anah'sis. 
These indicated to the General Education Commiliee the degree lo which individual courses 
approved lo satisfy General Education requirements are in fact addressing related goals, at least 
so far as the instructors of these courses •■eporl. L;iicr xiudies should address these same questions 
10 students to see the extent they view the goals as being emphasized in the courses. A complete 
description of the results can be found in Rogers. Bolland. and Ernest (1989). 

Discussion 

The process of L-slablishing the relationship of the institution's General Education goals and 
COMP objectives provided data lo determine which goals were and were not being assessed. An 
analysis of the unmeasuretl jLnah yielded areas where alternative measures were needed. For .some 
goals where COMP di)es nnl ad^'quaiely assess the goal, other published andA>r nonpublished 
instruments may be tried, ci.. Eison's Leaming-Orienied (J :idc-Orieniated scale for changes in 
ittitudes for lifeUmg learning (Hison, 19iSi. lys:; hi...i ;. ?. lu\ k Miltim. IVS2: Rop:is k Palmer. 
1987; R<^gers, Palmer, & B(3len, 19SS). For other gonis. there may be no national test available, 
thus local tests, questionnaires, and/or other measures and strategics (e.g., collection of qualitative 
data, review/an.tlysis of existing records, examination of umibtrusive measures, etc) may need to 
be developed to assess prtigrcss lowaril tin -.e Ud.ils. 



li 



As longitudinal data on student progress toward General Education goals accumulates and 
relatively weak areas are identified, the matrix can be used to identify how many and which courses 
are addnissing those goals. Steps can then be taken to strengthen this component bj' modification 
of existing courses or by addition of other courses. 

Thl" process can be used by other ptisUecondary institutions for relating their general 
education outcomes to available measurement instruments. By expanding the columns of the 
matrix, multiple tests could be cc?mparcd for their relative congruency with an institution's gtJals. 
UM US planning to repeat this process with the Academic Protlle. As supplementary measures are 
adopted, columns can be added until all goals arc being assessed. The key is still the triangulalion 
or overlapping of the general education core goals, the general education core counscs, and the 
instrument used to measure the goals. 

'ITius, when triangulation Is achieved, the test, goals, and core courses are overlapping and 
we have achieved \alidity.'' However, a lack of overlap of any two of the components sugge.sls 
problems. For example, if the goals and the test overlap (i.e., area "A" in Figure 1), wc may need 
to examine further the aiurees or examine if, indeed, the goals are appropriate. 

It should be noted that faculty involvement in this prtx-ess has the added advantage (>l 
serving faculty development by stimulating discussion about innovative ways of assessing ofu :i 
difllcuU^o-meiLsure outcomes that can also be used as models lor assessment of student learning 
in ihe classrixjm. Further, the process proved to he non-threatening to faculty and sef\'ed as a 
way to clarify and assess their goals. 
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APPENDIX A 



Statement of PuqK^ses and Goals of the Core 
Educational Program University of Montevallo 

The core educational program of the Unive.^ity of Montcvallo introduces students to a 
broad spectrum of knowledge and experiences designed to develop the mind, the emotions, the 
spirit, and the body. The purpm^ of the program are to enable students to participate as 
respoasibic, informod citizens in a democratic society and in the global community; to become self- 
educating individuals; to work creatively and effective^; and to lead satisfying personal lives. 

To ai^ompHsh these purposes, the core educational program cnablo; students to attain the 
following goals: 

1, To develop skills in the use and interpretation of symbol systems which employ 
words, numbers, and visual/aural imagery; $pecincally« 

a. to develop the ability to use and interpret language in written and spoken 
forms 

b. to develop the ability to use and interpret nrithcmatical structures 

c- to develop the ability to interpret other visuai and auditory symbol sN-stems. 

2- To develop the ability to use rational processes in consideration of ideas and 
problems, including the ability to make judgments based ujwn description* analysis, 
and interpretation, 

3, To search for and develop personal family, and community values through a study 
of the past, its vitality in the present, and its relevance to the future; specific;illy, 
by enabling students 

a. to analyze human developments and behavior 

b. to understand the hislorv of ideas 

c. to learn about political, social (family :h3u community), economic, 
philosophical, and religious sj'stems by which humanity has organized itself, 

4. To develop the ability to explore and appreciate the imaginative presenlalii^n iM' 
human experience through literary, visuai, performing, and other arts. 

5. To become knowledgeable alxiut the physical and biological structure of nature, ihc 
place of humanity in the natural world, and the ethical, economic, and political 
dimensions of humanity*s impact on the environment. 

6, To apply knowledge about health, nutrition, ph>"sical activity, and aesthetics U) w'lr 
persi)nal lives and environments and to their communities. 
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7. To dcvebp the ability to engage in effective interpersonal Fclationships, to 
understand their responsibilities in the American democratic community and in the 
world-wide human commum'ty, and to understand leadership roles. 

8. To develop inner resources siKih t& imagination, a sense of wonder, self-discipline, 
and a habit of critical inquiiy so that they may engage in lifelong, self-dircctcd 
learning. 

9. To affirm the value of work and leisure, to become aware of the wide range of 
career and leisure opportunities through which thc^ may make contributions to 
society and achieve personal sati&factbn, and to develop the scif-icnowlcdge, the 
competencies, and the qualities of mind (see Goals 1-8 above) which contribute to 
successful employment md fruitful living. 

10. To become knowledgeable about the prosj^ts for change occurring in their 
lifetimes and in subsequent generations so that they may be able to adapt to new 
conditions and to demonstrate responsible, creative leadership in shaping a changing 
world. 



University of Montcvallo Core Curriculum Committee. (1983). A proposal to University of 
Montevallo faculty of a revs^ core educational pm gram . Montcvallo, AL: Author. 
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APPENDIX B 



THE MONTEVALLO MODEL 



INPUTS 



I 

Sources of 

information 
and control 



GENERAL 
EDUCATION 
PROGRAM 



nENERAL 

EDUCATION 

COURSES 



Course desi Mil 
Course review 
Faculty survey 
Student survey 
Interviews 
Other 



OTHER 
COURSES 



Faculty development 
Faculty survey 
Student survey 
Anecdotal 
information 



CO-CURRICULAR 
PROGRAMS 



Student survey 
Records 

Program in^^onnation 



STUDENT ENTRY 
ATTITUDES 
& SKILLS 



ACT scores 
LOGO scale 
Learning skills 
Attitude scales 
COMP scores 



I 

Sources of 
information 
and control 



> OUTCOMES 



Content analysis 
Local validity 
Student surveys 
Tracking students 
Pre-post measures 
Reference groups 



Surveys 
Anecdotal 

information 
Interviews 
Case studies 



Anecdotal 

information 
Interviews 
Case Studies 



TEST SCORES 
COMP 
WRITING 
LOGO 
OTHER 



PERCEPTIONS 

STUDENTS 

FACULTY 

ALUMNI 

GRADUATE 
SCHOOLS 

EMPLOYERS 



QUALITATIVE 
EVALUATIONS 



Anecdotal 

information 
Student records 
Interviews 
Other documentation 



GOAL- FREE 
OUTCOMES 
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APPENDIX C 

rHE RELATIONSHIP BETWEEN THE CORE CURRICULUM AM) C^OMP COALS 

(With Q'icstionnairc Items) 

COMP MATRIX 



Core Go'ils 



1. To dc\i:lop skilb in the use 
and inierprciaiion of 
sj-mbo! Kj'Kicms whidi 
cmplw utirds, numbers, 
and visual aural imager)" 
iipecificii!!): 



l.a to dcvci.^p I he abilily lo 
ase and :nuTprct language 
in wriucn and spoken 
forms 



l b. to develop the ability lo 
use ;ind inierprci 
m;jiticmjt;w-al struaures 



l.a 10 de\'elop ihe abiUiy lo 
micrprci other visual and 
audited)' sj'mboJ ^•sicms 



COMP GoaU 



A. Can receive infoiroaiion from 
urai presentation, media 
prc^ntairais, and nonverbal 
cue& 

B. Can send informauon via speech^ 
media, and nonverbal 
presentations. 

C (!an r'.a:i\« information from 
written materials. 

D. C-an send information using 
written materials 



Can receive information from 
numeric and graphic 
rcprcscniatioi^ 

F. Can send information using 
numeric and graphic 
rcfM'esentations. 



A, Can rcosivc infwmatiai from 
oral presentation, media 
prescntatitmfi, and noiverbal 
sues* 

B. Can send informatk>n via speech, 
media, and nonverbal 
{n^ntation&. 
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COMP 
QucsUons 



1^2, 7-8, 1344 



lOMlW, 109-110, 
115-116 



55-56, 65^, 71- 
72, 

79-80, 87^,95'% 



19-20,31^32,4.^44 
21-22, 33-34, 



1-2, 74?, 13-14, 



103-104, 1C<).110, 
115-1 16 



Faculty Survey Quo^tsons 



J. lo be able to understand. anal>zc, 
and/(^ interprei written or spcJien 
language 

4. To be aWe to iratKmit verbal 
(oral and/iM- written) informaiii^i 



2. To be abie to understand, ana^w, 
and/or interpret mathematical 
siruaures (in numeric and/or 
graphic fcMTn) 

5, To be able to transmit numeric 
andA>r graphic information 



To ^ able to understand, anatya 
and/or interjni^ nOTmathcmaiical, 
vi^al, CH* auditory symbol systems 

To be aNe to uanimit ncxivcrbal 
infwnatfew 
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ApiK-ndix C 0>niiii 



Core Goals 



Ci^mp Goals 



Comp 



To itewfop the iibtlK> to 
use raikmal procr»**e^ m 
ciM^Mdcniikm of itici^ xri 
pn^lcm&p including the 
iy 10 make juUgmtnis^ 
i upon descripiton, 
. ,ysi% and inicqjretaiion. 



Cf . ( 4in identify and define prtiblcms 
lOhji'ciK'es and ci^siniining 

11 Can Mrica approaches to uMm! 
prtH5lcms. 

1. Can generate po&wble solutionis 
hypotheses, or testable 
i;»t)pa»tkm 

J. Can oMca \^rious fcHins o( 
informatkMi fdaia") regarding 
proposed solmiiins ^iih respea 
to a problem and ii^ constraints. 

IC Can determine ihe logical 
eonsisiency umong the 
information obtained, the 
pn "Icm as dePred, and the 
Jnr* jthcscs or wJuiiom {^oposed, 

L Cm (tetermine tt% solution lo be 
implcmcnicd. 

M. propose or select prcK^urcs 
to evaluate ("ajnfirm" the 
appropriaienoss of) the sc^ution 
chc^cn for imi^cmentatron 

N. C^n evaluate the prcx-c^ 
which a problem wj^ ^'solviJd/ 

P. Can ^^ss a set of suHuc^ for 
iniema! consistency. 

Q, C-an itkntify the major influence 
in the develc^mcnt of values in 
individual 

R. Gin anal>'ze rationales for value 
choices. 

S. Can infer persm^ values from 
behavic^*. 

T. Cto ^lyze the implicatic»» of 
deci^ms made the basis of 
valu^ 



.^-4, 9-10, 15-16 

107-108. 113^114, 
119-^120 

57-58, 65-f'6,ZV74 
59-60,67-68, 75-76 



85.^1, 91-92, V9^ 
100 



93*94, 101- 

102 

1V24, 35-36, 47-48 



25^26, 37-38, 49-50 

105^106, nM12, 
117-118 

61^2,69-70,77-78 



81-82,89-90, 97^98 
27-28,39-40,51-52 
29-30,4142, 53-54 



Faculty Survey Qucslions 



7- To be able to analvA? problems 
(identify, define, select 
approaches) 

a To be able to select or create 
Si^utions to probtems (e,g^ 
generate fypothcscs, colica 
infom^tion, analyse tnformaiicm, 
evaSume probaWe effects of 
solutions) 

9. To be able to evaluate proWcm- 
w:)lving proces^^ 

10. To develop the ability to make 
rational judgments t^iscd on 
description, jinalysis, and 
intcrpretatjon of ideas and 
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Qimp Goals 



3, 111 search for nnU dcMrlop 
p >tm;il, fjinjly, and 
iunvnuniiy valuer through 
it siuciy ihe past, its 
viialiiy in ihc present, and 
iis relevance to ihc future; 
specifically, by enabling 
Muticnts 



3.a. to iinalyzc human 
dcM^lopmcni and behavior 



3.b. to understand the history 
of ideas 



3.C, to learn about political, 
soeial (family and 
community), economic, 
philosophical, and religious 
miemK which humanity 
hii% L^ganixcd iLsclf. 



0. Cm) identify the a^jcff influence 
in the devciopmeni nf values in 
individuals. 

S. Can infCT persima! valui^ from 
t^havior. 

T. C^n ana^ the implication of 
decmons mi^e m the t^n> of 
values. 

3. Can cxptot the rcajrocal 
rclation^ip between socia! 
instiiutkm and individuals. 



0. Can identify the majcr values, 
and i^^ UMiaily faced, in daily 
adult life in one*s own and cHhcr 
cultures. 

1. Can identify ih<%e activities and 
instiiutk^ uiiid) constitute the 
sodal ^ipccts of a cultunc, 

Z descrite the structure and 
functiom that underlie social 
institutkMis. 

3. Can explain tte reciprocal 
reiatiomhip between soci^ 
imiituiteaas and individuateu 

5. Qui exj^in ite impUcit re^itunu 
and frt&knm with in tte socM 
institutksss, bxhS cm prefect tow 
degree of involvement 
in a ocmflk^ing or compatibte 
i^te. 



Ct^mp 
Questions 



Faculty Survey Oucsiions 



61-62,69^70, 77.78 

27^28, 39-W, 51-52 
29^30,4M2, 53-54 



55-56, 57-58, 59- 
60, 61-62 



5>6, 1M2, 17^18 



1-2, 34, 5-6 



103-104, 107-108, 
lil5-106 



55-56, 57-58, 59- 
60, 61-62 



19-20, 21-22, 23- 
24, 25-26, 27-28, 
29-30 



19. To analjTJC human dcvclopncm 
am) behavior 



3L To understand the hii^ory of ideas 



15. 



16. 



17. 



To develop persona] vtiIucs 
through studying the past to 
rcbtioitthip to the |m:sent and 
future 

To devetop family valu^ through 

studying the pc^t in relattonship to 

the present and future 

To de^iop community values 

thftnigh studying tte jmi in 

relationship to the present and 

future 



2S. To understand one or more ctf 
ti^ wg^erm (pc^ical, social, 
ccMomic, fAilosq*ical, religious) 
which humanity is c»*ganized 

24. To describe the struaun^ and 
fui^offii that umtetlie social 
tnstitutk)ns 
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Appendix C Q)nlinuL*J 
Core Goals 



Comp 
Quolions 



Faculty Suncy Questions 



25. lo explain ihc rcdprucul 
rclahiinxhip bciwecn M€in\ 
iMiiixxikm and individuals 

26. To identify ihc aciivilics and 
imiiiutions that coasUiutc the 
scKUil a^cis iif 0 culture 

2Z To explain the restraint and 
frccdcm within iiodal tnKtitutii>ns 

28. To predict how degree of 
invohxrmcni in scxrial instiiuiions; 
places mc in a conflicting or 
compatible slate 

Ml To cxpkiin the {^inciples of the 
dc^'eJopnicni and change of social 
inMiiutions 



4. To dcvekjp the abilirj' to 
explore and apprcnate the 
iniaginati\^ presentation of 
human experience through 
literary, vjjmal, performing, 
and other arts 



1 h Can icteniify thi^ actrvitit^ and 
prtxiuctfs which amsinuic the 
anuaic/humanlsttc aspects of a 
culture 

12. C!an dcMTibe the cIcmcniR (c.g*, 
sensory, composaional, 
expressive, and substantive) that 
constitute artsstic/humanistic 
activities and prcxlun^ 

13. Can explain the impact of 
anisttc/humanisiic cxpa'&%ion^ on 
individuals. 

14. Can cxpbiin the dc\'clopmcnt of 
aesthetic a%^-iircn(^ and theor>* 
from a numIxT of perspectives. 

15. Given the characteristics of a 
culture, can judge which of 
several artistic/humanistic 
cxj^'cs^ons wc^ld be mc^ 
congruent with those 
characteristics. 



13-14,15-16,17-18 



117-118 



71-72, 73-74, 75- 
76. 77*78 



102, 97.MS 



43-44, 45-46, 47- 
48, 49-50, 51-52, 
53^54 



34. To explore and appreciate the 
imaginative presentation of human 
experience through the arts 
(visual, litci^ry, performing, and 
other) 

35. To identify^ the acinities and 
products that constitute the 
ariistic/hunKinislic aspects of a 
culture 

36. To dcj^criN: the clcmcnis that 
constitute ariisiicyliumanisiic 
aspjcts of a culture 

37. To explain the impact of 
anistic^umanhiiic expressions on 
individuals. 

38. To cxpbin, from a number of 
perspediws, the dcvclopmeni of 
acMhetic auarcncss and theory 

39. Tu be able to judge i*1iidi of 
several artistic/humanistic 
at|»^s^ms mnild be most 
congruent with pivcn 
characteristics of a culture 
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Api>cndix C Coniinucu 



Cxnc Goals 



Comp Coals 



*Io bca>mc kncmicdseabtc 
about I he ptn-Mca! and 
bitih>gical Mruaure of 
naiurc, it^ place of 
humanity m ilk natural 
uxnid, and ite ethical, 
ccQn4>mic, and polhica! 
dimcmions of hiimaniij's 
impaa on the cmironmcnt. 



lo apply kiKiwletlge about 
health, nutrition, phj-sical 
anivity, and aesthetics to 
their pcrjional lA^es and 
cmironmenis aiid lo tbcir 
cummunitic^ 



7. To develop the ability to 
engage in effective 
interpersonal relatiomhi|^ 
to understand their 
respomibilit^ in the 
American demoeraiic 
community and in the 
world-wide human 
community, and to 
understand leadership roles. 



6, Ci,n identify ihc»»c ;» *t\H\vs and 
p-cxluctR which i ' the 
socntificAcchnuloiiu.. .ispcct.s ot 
a culture. 

7. Can do^be scicntiHc miccfn^ 
laws CH* imndf^ that underlie 
sckrniiCicA^nc^ogiutl aeitvitics 
and ptxJuctR- 

Can explain the impact of 
tecbnc^gy m ^ he nat ural 
(phj'sical and hiplogicat) 
envirtmmem in whuti n ixrcurs. 

9- Can explain the impact of 
tcchnok:^ on the jruitiiutK>i^I 
and hiKyher culture. 

10, Can [n'edict the consequences of 
tte introduction of technology 
into a cuhure, including 
a»i^leraiiiM^ of the .^ntiftc 
prineiptes mvoM^d ami of Itic 
eminfiimental amj cult ural 
impaos of technique. 

T. Can analyze the in^plicaltons of 
ded^ons n^adc on the \xim of 
values. 



C'oinp 
Qucslinns 



111-112 



63^, 6S-<*. 67^ 
68, 69^70 



87-88, 91^92. 
94, 89-«) 



31^32, 33^34, ^5^ 
36, 37-38, 3V- ;u, 
4W2 



29-30,41-42. 53v^4 



Faculty Surwy Questions 



40. To become knowledgeahte about 
the phwcal and biological 
.structure of nature 

41. To imdcn^and the place ctf 
humanity in the natural v^wld 

42. To bcconw knowledgcabte abtwt 
the ethical mmomic, and politicat 
dimcn^om of humanity's impact 
cm the environment 

43. To identify the activities and 
products thai cof^itutc the 
scscntific/technological aspects of 
a cuhure 

44. lb (tescribe scientific concepts, 
laws, or principles 

45. To ocplain technology's impact on 
physiological and biological 
emironmcnts 

46. To explain technology's impact cm 
the indtMdual and hfii^ber culture 

47. To predict the cnvirOTmenial and 
cultural consequences of 
intrcxlucing icdmt>k^gy Into a 
cuhure 



48. 



To apply kmnvlcdge about health, 
nutriticm, ph>'sical activity, and/or 
acAtheticx to iheir h\'cs and 
cnvinmmcnis 



29, 



To understand one's 
rcspoj^ibilitics in the American 
world-wide communities 



32. To understand leadership roles 
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Core Goals 



C4imp Goals 



To Ucwltf) inner rcscmrccs 
such as imaginaiinn, a 
sense of utMidcr, v.^f- 
diSAHpline, and a habii of 
criucal inquiry $o ibai they 
may engage in lifetoig, self- 
directed learning. 



9. To affirm tte value of 
mirk and teisurc, to 
beome aware of the ^vKk: 
range of career and leisure 
opponuniiics thi ough which 
ihcy may make 
coniributioM to society and 
achieve personal 
satisfaction, and to ctevclop 
the self-knowledge, the 
cximpeiendc^ aiKi the 
quaiiiies of mind (sec 
Goals 1-8 above) which 
contribute to sucecaa^ful 
cmplajTOcnt and fruitful 



10, To become knowledgeable 
about the prospects for 
change occurring in their 
lifetimes and in subsequent 
generations so that they 
may be able to mlapt to 
new conditions and to 
demonstrate rc&pM&ibte, 
CTcaijv^ leadership in 
shaping a changing world. 



Comp 
Questions 



4. (Tan explain be principles of the 
dcvclopnHrnt ^nd change of social 
institutkir^. 

9. Can explain the impact of 
technology cm the mstituftonal 
and his/her culture. 

10, Can predict the consequences of 
the introductk>n of technology 
into a culture, sidudtng 
wnsideraijom of the scientific 
principles involved and of the 
cmironmental and cultural 
im|Uicis of technique. 
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79-80, 85^, S3- 
84, 81^2 



87^, 9 J -92, 
94, 89*W 



4M2 



Vu J:v SuiAvv Oitirslions 



11. io dCNvk^ the inner resources 
im;ij:jn:uton, sclfniwciplinc, 
;i it>u i»! cniK.i! inquit}) nccess;iiy 
Uir life-long, Mjlf-dircaed teaming 



21. To airirm the value of and 
leisure 



I"o N:comc aware of ihc wdc 
range itf causer and leisua- 
i?ppoftunitics through vlitdi mc 
mo)' make contributions to sodciy 
and achie\*e petrosal sattsfaaiun 



3.^. To bccc»nc kncwledgcablc about 
the priTSpecis for change in the 
near and far^tam future 

30. Ti) explain the pnnciplcs of 
development and change of sociai 
insiitutiims 
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APPKNDIX D 



SAMPLE CURRICULUM VALIDATION WOi KSHl-iT 



CORE GOAL #1: 



To develop skills in the use and inlurprciation of symlx)! r vsicnui which employ wordx. 
numbers, and vLsual/aural imagery, specifically, 

a, to develop the ability to use and interpret language in and six)kcn forms. 

b, to develop the ability to use and interpret mathemalical structures 

c, to develop the ability to interpret other visual and auditory symbol systems. 



RELATED COM? OBJECTIVES: 

A Can receive information from oral 
presentations, media prc^ntations, 
and unwritten cua>. 

6 Can send information via speech, 
media, and nonverbal presentations. 

C Can recervc information from written 
roatcnals 



COMP Q #s 



1-2, 7-8, 13-14 



103-104. 109-110, 115-116 



55-56, 63-64, 71-72 



D Can send information using written 
materials. 

E Can receiw information using numeric 
and giaphic representations. 

F Can receive information from numeric 
and graphic representations. 



79-80, 87-88 95-% 
19-20. 31-32, 43-44 
21-22. 33-34, 45-46 
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